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NOTATION 



Xi(t), 

T 

Px (t) , 

a x 



a 2 

c 

bx 

b 2 

v 



u 

V* , u* 
J 

T 



X 2 (t), Yx(t), Y 2 (t) — State variables, number of 
survivors of Xx , X 2 , Yx, Y 2 at time t. 

— Specified duration of the "approach to contact". 

p 2 ( t ) , qi(t), q 2 (t) — Adjoint (dual) variables, the 
value of Xx , X 2 , Yx, Y 2 respectively at time t. 

— Attrition rate coefficient, average rate at which 
are Y 2 attrits X x . 

— Average rate at which one Y 2 attrits X 2 . 

— Average rate at which one Yx attrits X x . 

— Average rate at which one X 2 attrits Yx. 

— Average rate at which one X 2 attrits Y 2 . 

— Decision (control) variable, fraction of Y 2 directed 
at Xx , 0 £ v _< 1. 

— Fraction of X 2 directed at Y x , 0 £ u <_ 1. 

— Optimal values of v and u. 

— Criterion functional (objective function). 

— Backwards time, x = T - t. 
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I. INTRODUCTION AND PURPOSE 



The subject of fire support allocation in military con- 
flict has received considerable attention during the last 
few years, particularly in the area of optimizing the dis- 
tribution of limited fire support resources. One specific 
example of the application of optimization techniques to 
such allocation problems is a paper by Kawara [1] in the 
field of differential games. In an extension of the work of 
Weiss [2], he examined the optimal strategies of two heter- 
ogeneous forces in a scenario in which each force consisted 
of a combat unit (such as infantry) and a support unit (such 
as artillery) wherein the strategy of each force was the 
distribution it made of its supporting fires between the 
other's infantry and artillery. Kawara concluded from his 
analysis that, given the artillery units of each opponent 
are never reduced to zero, the optimal strategies of the 
opponents are independent of force levels. 

Taylor [3] showed, for a given set of combat attrition 
equations such as used by Kawara, that optimal strategies 
are a function of the criterion functional (objective func- 
tion), and that he (Kawara) picked the only type of criterion 
functional — the ratio of combatants at the end of the en- 
gagement — which produced optimal strategies completely in- 
dependent of force levels. Taylor also examined a modified 
version of Kawara ' s model in order to show that not only can 
the optimal strategy of one of the combatants depend directly 
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on the enemy force levels, but also that the optimal strategy 
of that side is to sometimes split its supporting fires be- 
tween the enemy's infantry and artillery. 

Ellis [4] considered in his thesis this same two-person, 
zero-sum differential game and its solution procedure (as 
outlined by Taylor) which consisted of synthesizing extremal 
trajectories'*' using a backwards sweep process. For his the- 
sis he constructed a lengthy computer program which numeri- 
cally implemented the backwards sweep process and allowed 
him to flood the state space with extremal trajectories. As 
an output from his program, Ellis created a two-dimensional 
computerized plot which most vividly illuminates the depend- 
ence of strategy on force levels in Taylor's model. 

However, while examining several cases of Taylor's scena- 
rio, Ellis found that, for several combinations of parameters 
and values of state variables used to initialize the back- 
wards sweep process, it was not possible to reach certain 
beginning values of the state space. This lack of trajec- 
tories passing through certain portions of the five-dimen- 
sional state space was coined as a "void” by Taylor. Taylor 
[3] subsequently provided an analytical explanation for the 
existence of the "void" discovered by Ellis, and developed 
a candidate solution for filling it with optimal trajectories. 



A trajectory generated by a realization of a strategy 
which satisfies the necessary conditions of optimality for 
all points in time. 
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The purpose of this thesis was to incorporate Taylor's 
solution for filling the "void" into the computational rou- 
tine developed by Ellis, to numerically solve the differen- 
tial game with the modified routine, and to demonstrate with 
graphical plot the effect of Taylor's solution for filling 
the "void". 
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II . DEVELOPMENT OF OPTIMAL TIME- SEQUENTIAL 



FIRE SUPPORT STRATEGIES 
A. THE COMBAT SCENARIO 

The combat scenario examined by Taylor [3] (extending 
previous work by Kawara [1] and Weiss [2]) consisted of two 
opposing heterogeneous forces in a fixed duration "approach 
to contact" wherein one's infantry, Xi , is attacking the 
other's infantry, Yi. The game terminates at the moment 
that contact (close combat) between combatants occurs (after 
a fixed time, T), whereupon artillery fires must be shifted 
from the enemy's infantry in order to preclude the inflict- 
ing of casualties on one's own infantry. Figure 1 depicts 
the situation examined by Taylor. 



1— u 




Figure 1. The Tactical Situation 
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As can be seen, each side's artillery can distribute its 
fires with complete latitude at its enemy's infantry and/or 
artillery. All attrition caused by artillery fires was as- 
sumed by Taylor to follow a "linear-law" attrition process, 
except for the defender's artillery, Y 2 , against the attack- 
er's artillery, X 2 , which was formulated as following a 
"square-law" attrition process in as much as it was felt the 
defender has superior target acquisition capability. Due to 
the condition that the attacker's infantry, Xi , is moving 
toward the defender's infantry, Yi, it was assumed that the 
Yi fires on Xi followed a "linear-law" attrition process, 
reflecting the difficulty of firing aimed fire at a moving 
target. One should also notice in Figure 1 that Xi has been 
pictured as placing no fires on Yi, so assumed because of 
the difficulty of delivering effective fire while in rapid 
movement to contact. The objective of both opponents during 
the "approach to contact" is to maximize the ratio of its 
infantry to its opponent's infantry at the moment the "ap- 
proach to contact" phase is ended and "close combat" begins. 
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B. DIFFERENTIAL GAME FORMULATION 



Taylor [3] modeled the scenario in section II. A. as a 
two-person, zero-sum differential game as follows: 



MAXIMIZE 


MINIMIZE 


J = X 1 (T)/Y 1 (T) 


2 


U 


V 






Subj ect To : 


dXx/dt = 


-vajXjYz - cXxYx 


(=fi ) 




dX 2 /dt = 


- ( 1-v )a 2 Y 2 


(=f 2 ) 




dYj/dt = 


-ubi Y i X 2 


(=gi ) 




dY 2 /dt = 


-(l-u)b 2 Y 2 X 2 


(=g2 ) 




0 £ u(t) 


£ 1 0 £ v ( t ) £ 


1 




0 < Y . ( t ) 


= Y. 1 








1 > i=l,2 


(SVIC's) 




0 < x i (t) 


= X ii 





Initial Conditions: X.(t=0) = X?, Y.(t=0) = Y° , i=l,2 

r 1 i v ' 1 

It is quite evident that the state variable inequality 
constraints (SVIC's) hold for all the state variables (X^, 
Y^, i=l,2) except for ,X 2 which can take on negative values, 
mathematically speaking; however, for the purposes of his 
examination, Taylor considered X 2 to remain strictly posi- 
tive, thus by-passing any need for consideration of the 
problems generated by SVIC's, such as discussed in Speyer 
[5] . 



2 In general J = J(t,X,Y, u,v) = G{X(T),Y(T)} 

T 

+ £ L{s,X(s),Y(s), u (s),v(s)}ds, but for 
Taylor's scenario, J = G{X(T),Y(T)} + 0 = X 1 (T)/Y 1 (T). 
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C. DEVELOPMENT OF SOLUTION 



In generating the solution to the differential game pre- 
sented in section II. B. , Taylor applied a method similar in 
form to that used in optimal control problems, utilizing the 
"Maximum Principle" as applied to differential games such as 
in [6] and the theory of singular extremals. At this time, 
it should be noted that the strategies developed by Taylor 
were not shown to satisfy sufficient conditions for optimal- 
ity, to do so being beyond the scope of the current investi- 
gation . 

The general steps followed by Taylor in generating the 
extremal controls to the differential game in section II. B. 
are outlined below: 

1. Introduce the dual (adjoint) variables pi(t), P 2 (t), 
QLi(t), q 2 (t) which correspond to the state variables Xj(t), 
X 2 (t), Yi(t), Y 2 (t), respectively. 

[p.(t) = 3W(t,X,Y)/3X.(t) 

where W(t,X,Y) is differentiable and 

W = ( t , X > Y) = W{t=0,X°,Y°; t=T,X(T) , Y(T) } 

= MAXIMUM MINIMUM J = X 1 (T)/Y 1 (T)] 
u( t o , T) v( t o ,T) 



2. Form the Hamiltonian H: 



H( t , X , Y, u , v ) = L( t , X , Y, u , v) + .^(p.f. + q ± g.) 



= . E- (p . f . +q.g.) 
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3. Determine the extremal strategic variable pair (ex- 
tremal controls), (u*,v*), by maximize-minimizing the Hamil- 
tonian . 

4. Construct the system of time history equations 
(canonical equations): 

dX./dt = 3H(t,X,Y,£,£,u*,v*)/3p.(t) 
dY./dt = 3H(t,X,Y,£,£,u*,v*)/3q.(t) 
dp ± /dt = -3H(t,X,Y,£,£,u*, v*)/3X i (t) 
dq ± /dt = -3H(t,X,Y,£,£,u*, v*)/3Y i (t) 
for i=l, 2 

5. Determine the terminal boundary conditions for the 
adjoint variables in preparation for synthesizing the ex- 
tremals in backwards time (t): 

p. (t=T) = p i (x=0) = 3G{X(T),Y(T)}/3X.(T) 

= 3{X 1 (T)/Y 1 (T)}/3X.(T) 

q. (t=T) = q ± ( t = 0 ) = 3G{X(T),Y(T)}/3Y i (T) 

= 3{X 1 (T)/Y 1 (T)}/3Y i (T) 

for i=l, 2 

6. Compute the amount of discontinuous jump made by the 
adjoint variables across a manifold of discontinuity of both 
u* and v*, simultaneously. A "void" in the state space 
occurs only in those cases where a discontinuity in the ad- 
joint variables exists. (Alternatively speaking, this final 
step covers the procedure for filling the "void", as devel- 
oped by Taylor [3] after the discovery of the existence of 
the "void" by Ellis [4].) 

For a detailed explanation of these six steps, see 



Taylor [3]. 
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III. FILLING THE "VOID" 



A. MODIFICATION OF THE COMPUTATIONAL ROUTINE 

The computer program developed by Ellis [4] which numer- 
ically synthesized the extremal controls to the differential 
game in section II. B. using Taylor's original (before the 
discovery of the state space "void") solution, consisted of 
546 lines of Fortran IV coding. Generally, the program en- 
compassed steps 1 through 5 listed in section II. C. 

In order to make an alteration to Ellis' program (to im- 
plement the filling of the "void", step 6 in section II. C.) 
without inadvertently and erroneously changing the basic 
logic scheme, it was first necessary to develop a flowchart 
outlining the logic used by Ellis. 

A detailed flowchart showing all the intricacies of meth- 
ods used in the program, such as the Runge-Kutta fourth-order 
numerical integration algorithm or the Newton-Raphson routine 
for numerically solving transcendental equations, would have 
been of no practical use; therefore, a block-type flowchart 
showing the inter-relationships between the critical segments 
of the backwards sweep process was drawn to model the over- 
all procedure of extremal synthesis and graphical plotting. 
Key flag and count variables were included in the diagram as 
well as all significant logic nodes. 

An immediate spinoff from the completed flowchart was to 
catch several errors in Ellis' train of logic which had not 
been previously detected during initial program operation 
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and debugging. Once Taylor's differential game solution was 
clearly understood, and Ellis' program steps were associated 
one-to-one with the solution steps, the incorporation of 
Taylor's solution for filling the "void" into Ellis' program 
was relatively uncomplicated, ultimately requiring only about 
50 lines of Fortran IV coding. 

Lastly, fine tuning of the numerical integration time 
steps affected by the modification was necessary in order to 
insure acceptable error level in the numerical approximations. 
(The verification of the numerical integration coding was 
previously accomplished by Ellis, and, therefore, not re- 
peated here. ) 

B. EXAMPLE OF FILLING THE "VOID" 

Figure 2 is a graphical plot, done on an IBM 360 computer, 
of a specific case of the differential game examined by Tay- 
lor in which a discontinuity in the adjoint (dual) variables 

existed. Note the dearth of trajectories through a large 

3 

portion of the two-dimensional state space (Z,t) , where t 
occurs during the initial stages of the approach to contact. 
The absence of extremal trajectories passing through those 
portions of the state space is what has been called the 
"void" . 



Z = Yi(t)/Y 2 (t) was picked by Ellis [4] as a suitable 
transformed state variable to demonstrate the force level 
dependence of optimal strategies. 
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Figure 2. The "Void" 

Moreover, once the modification to Ellis' computer pro- 
gram (incorporating the discontinuous jump of the adjoint 
variables £ and £ at the manifold of discontinuity of u* and 
v*) was applied, this same "void" was subsequently flooded 
by optimal trajectories as graphically displayed in Figure 
3 . 
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z 




Figure 3. The Filled "Void” 

To explain Figures 2 and 3 further, the discontinuity of 
v* occurs on the v* transition surface, and the discontinuity 
of u* on the u* transition surface, depicted by the dark ex- 
tremal trajectory in Figure 3. The intersection of these 
two transition surfaces, indicated by a circle in both Fig- 
ures 2 and 3, is the point in backwards time where the "void" 
occurs, as clearly seen in Figure 2. 
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IV. SIGNIFICANCE OF THE MODEL AND ITS SOLUTION 



A. INTERPRETATION OF THE SOLUTION 

The first objective of Taylor's [3] work was to show 
that optimal strategies are not necessarily independent of 
force levels; this Ellis [4] aptly illustrated by his plot- 
ting the transformed state variable, Z, against time, which 
indicated the shift of strategy in conjunction with particu- 
lar enemy force levels. Even more vividly, under certain 
circumstances in Taylor's solution, the following equation 
holds : 

u = {b 2 /(b 1 +b 2 )} (l-q 2 Y 2 /p 2 X 2 ) 

which demonstrates explicitly the dependence of strategy on 
force levels, in this case Y 2 and X 2 . In mathematical terms, 
the strategies are closed-loop strategies in that 
U = U{ t ,X( t ) , Y( t ) } and V = V{ t ,X( t ) , Y( t ) } , or, in other 
words, the strategies of the opponents are feedback depend- 
ent. In military terms, the significance of these results 
is that intelligence concerning the enemy force levels is 
extremely important in the development of one's strategy. 
Because of the uncertainty inherent in intelligence estimates 
in the real world, Taylor's results imply that one's strat- 
egy must be continuously reevaluated as a result of the 
changing intelligence picture. 

The second objective that Taylor sought to accomplish 
was to illustrate the fact that supporting fires may be 
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split between opposing forces. There exists in the solution 
to Taylor's model specific instances when the optimal strat- 
egy is to fire on the enemy's two different forces propor- 
tional to their relative strengths; or, mathematically 
speaking, 

u = b 2 /(bi+b 2 ), 1-u = b i / ( b i +b 2 ) 

such that they are attrited at proportionally the same rate, 
keeping Z = Y!(t)/Y 2 (t) constant. This is well illustrated 
in the graphical plot developed by Ellis when an extremal 
remains at a constant level for a finite period of time as 
seen between t* and t** in Figure 4, picturing a single op- 
timal trajectory extracted from Figure 3. 



Z 




Figure 4 
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Notwithstanding, the most significant lesson that can be 
learned from the combined results of this work, Taylor [3] 
and Ellis [4] is aimed not at the military decision maker, 
but at the analyst who is attempting to model combat dynam- 
ics: in a differential game, the form of the dynamics used 
to depict a situation may impose unacceptable characteristics 
on the strategies of the game players, causing them to vio- 
late very basic concepts from the real world the analyst is 
attempting to model, such as in the case of Kawara [1]. 

B . FUTURE CONCERNS 

There appears to be a logical extension of this work 
that could be made, possibly to satisfy a Master's Thesis 
requirement, beginning with the assignment of appropriate 
constants of dimensionality to Taylor's model, such an under- 
taking being necessary before the military artist can ef- 
fectively interpret the strategy or tactics that the 
differential game solution dictates. Once this is accom- 
plished, of further interest would be a sensitivity analysis 
on the model, using Ellis' program as modified by this 
thesis. 

For the interested reader, the resultant program, flow- 
chart, and computer cards from this work may be obtained 
from Associate Professor James G. Taylor, Department of Op- 
erations Research and Administrative Sciences, Naval Post- 
graduate School, Monterey, California 93940. 
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V . SUMMARY 



The method Taylor [3] derived for filling the "void" 
found in his original solution to the modified version of 
Kawara's [1] differential game has been found to be success- 
ful. Such was shown to be true by means of incorporating 
the aforementioned method into Ellis' [4] computer routine 
for numerically executing Taylor's original solution, and 
then looking at "before" and "after" snapshots of a case in- 
volving a "void". 

> 

The force level dependence of optimal strategies, the 
splitting of supporting fires, and the sensitivity of strat- 
egy to model attrition dynamics has also been discussed. 
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